This slide is intentionally left blank. 


Bo 


STUDIOS. GUERRILLA DECIMA 


Photograph 


STUDIOS. GUERRLLA 


SIGGRAPH 2022 im DA 
@) RE ae SIGGRAPH 2022 Advances in Real-Time Rendering in Games course 


em Zero Dawn, 2017 


SIGGRAPH 2022 E EMO 
@) EE (8.1 AUG SIGGRAPH 2022 Advances in Real-Time Rendering in Games course 


STUDIOS. curam TY 


Visualization 


® 


SIGGRAPH 2022 


VANCOUVER+ 8-11 AUG 


“Cloud Coverage” “Cloud Type” “Perlin-Worley” 


SIGGRAPH 2022 Advances in Real-Time Rendering in Games course 


STUDIOS 


GUERRIL La 


GPU PRO” 


The Real-Time Volumetric Nubis: Authoring Real-Time 


1 P i ! TUE Real-Time Volumetric 
C oudscapes O Volumetric Cloudscapes Cloudscapes for Games 
Horizon Zero Dawn with the Decima Engine (2016) 


@) SIGGRAPH 2022 SIGGRAPH 2022 Advances in Real-Time Rendering in Games course mm lá 


VANCOUVER+ 8-11 AUG 


S GUERILLA 


Horizon Forbidden West, 2022 


SIGGRAPH 2022 : im imu 
@) VANCOUVER. [8 E AUR SIGGRAPH 2022 Advances in Real-Time Rendering in Games course 


STUDIOS. GUERRLLA 


'NUBIS EVOLVED / Background 


Cr5ECIMA N NUBIS ©) DECIMA 


dvances in Real-Time Rendering, Siggraph 2017 
ENNE 
Ge " 
é á S mm Saray + * 


~ 


g. Beb 2017 
dia 


@) SIGGRAPH 2022 SIGGRAPH 2022 Advances in Real-Time Rendering in Games course 


VANCOUVER+ 8-11 AUG 


STUDIOS. cuerri 


'NUBIS EVOLVED / Background 


Hot Air 


@) SIGGRAPH 2022 
VANCOUVER+ 8-11 AUG 


SIGGRAPH 2022 Advances in Real-Time Rendering in Games course 


NUBIS EVOLVED / Background 


Photograph 


@) SIGGRAPH 2022 SIGGRAPH 2022 Advances in Real-Time Rendering in Games course 


VANCOUVER+ 8-11 AUG 


'NUBIS EVOLVED / Background 


Luke Howard, 1802 


@) SIGGRAPH 2022 
VANCOUVER+ 8-11 AUG 


Cirrus > 


Cumulus » 


Stratus > 


SIGGRAPH 2022 Advances in Real-Time Rendering in Games course 


“Nubification” 


“Nubis” 


STUDIOS. GUERRLLA 


'NUBIS EVOLVED / Skies 


NUBIS EVOLVED / skies / Background 


» Structure 


MEME 


> Movement 


> Color 


md F ge pu 
. m si Pe 
ag eem tm V zeit 


Photograph 


@) SIGGRAPH 2022 SIGGRAPH 2022 Advances in Real-Time Rendering in Games course 


VANCOUVER+ 8-11 AUG 


STUDIOS. GUERRLLA 


NUBIS EVOLVED / Skies / Structure 


“Tropospheric Clouds” 


Cirrostratus Cirrus 


Ss fle aiio ao queo 


Altostratus Altocumulus 


SOONE ETE Ww t 


Stratus Stratocumulus Cumulus Cumulonimbus 


@) SIGGRAPH 2022 SIGGRAPH 2022 Advances in Real-Time Rendering in Games course 


VANCOUVER+ 8-11 AUG 


8000m 


4000m 


1500m 


STUDIOS 


prm 


-NUBIS EVOLVED / skies / Structure 


Stratus Sub-Layer 


@) SIGGRAPH 2022 SIGGRAPH 2022 Advances in Real-Time Rendering in Games course 


VANCOUVER+ 8-11 AUG 


Cirrus Sub-Layer 


STUDIOS. cuerri 


-NUBIS EVOLVED / Skies / Structure 


Nubis Data Fields 


“NDF s? 


@) SIGGRAPH 2022 SIGGRAPH 2022 Advances in Real-Time Rendering in Games course 


VANCOUVER+ 8-11 AUG 


STUDIOS. GUERRLLA 


-NUBIS EVOLVED / Skies / Structure 


2D NDF Mapping 


16km 


16km 


@) SIGGRAPH 2022 SIGGRAPH 2022 Advances in Real-Time Rendering in Games course 


VANCOUVER+ 8-11 AUG 


STUDIOS. GUERRLLA 


-NUBIS EVOLVED / Skies / Vertical Profile Model 


x 


Vertical Profile Model 


@) SIGGRAPH 2022 SIGGRAPH 2022 Advances in Real-Time Rendering in Games course 


VANCOUVER+ 8-11 AUG 


STUDIOS. GUERRLLA 


-NUBIS EVOLVED / Skies / Vertical Profile Model 


“Vertical Profile Model NDFs” 


Cloud Min Height 
Cloud Max Height 
Cloud Coverage 
Cloud Bottom Type 
Cloud Top Type 


SIGGRAPH 2022 : E cud 
@) EE [8 E AUR SIGGRAPH 2022 Advances in Real-Time Rendering in Games course 


STUDIOS. GUERRLLA 


-NUBIS EVOLVED / Skies / Vertical Profile Model / Modeling Densitu 


Top Type 


O ÁC 


Height Straataumuulıss 


@) SIGGRAPH 2022 SIGGRAPH 2022 Advances in Real-Time Rendering in Games course 


VANCOUVER+ 8-11 AUG 


STUDIOS. GUERRLLA 


-NUBIS EVOLVED / Skies / Vertical Profile Model / Modeling Densitu 


Height 


Top Type 


@) SIGGRAPH 2022 SIGGRAPH 2022 Advances in Real-Time Rendering in Games course 


VANCOUVER+ 8-11 AUG 


STUDIOS. GUERRLLA 


NUBIS EVOLVED / skies / Vertical Profile Model / Modeling Densitu 


In-Engine Render 


@) SIGGRAPH 2022 SIGGRAPH 2022 Advances in Real-Time Rendering in Games course 


VANCOUVER+ 8-11 AUG 


NUBIS EVOLVED / skies / Vertical Profile Model / Modeling Densitu 


In-Engine Render 


@) SIGGRAPH 2022 SIGGRAPH 2022 Advances in Real-Time Rendering in Games course 


VANCOUVER+ 8-11 AUG 


NUBIS EVOLVED / skies / Vertical Profile Model / Modeling Densitu 


In-Engine Render 


@) SIGGRAPH 2022 SIGGRAPH 2022 Advances in Real-Time Rendering in Games course 


VANCOUVER+ 8-11 AUG 


-NUBIS EVOLVED / Skies / Vertical Profile Model / Modeling Densitu 


Height 


Cloud Bottom Type 


@) SIGGRAPH 2022 SIGGRAPH 2022 Advances in Real-Time Rendering in Games course 


VANCOUVER+ 8-11 AUG 


STUDIOS. GUERRLLA 


NUBIS EVOLVED / skies / Vertical Profile Model / Modeling Densitu 


In-Engine Render 


@) SIGGRAPH 2022 SIGGRAPH 2022 Advances in Real-Time Rendering in Games course 


VANCOUVER+ 8-11 AUG 


-NUBIS EVOLVED / Skies / Vertical Profile Model / Modeling Densitu 


“Vertical Profile” 


@) SIGGRAPH 2022 SIGGRAPH 2022 Advances in Real-Time Rendering in Games course 


VANCOUVER+ 8-11 AUG 


STUDIOS. GUERRLLA 


'NUBIS EVOLVED / Skies / Vertical Profile Model / Modeling Density 


Coverage 


0 —————————————————!—— o' O^ .-—'"'''"'-— 4 —crÀÀ—Á—Ó 


float dimensional profile - vertical profile * cloud coverage; 
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float cloud density - saturate(cloud noise composite - (1.0 - dimensional profile)); 
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float3 noise sample position = sample position - wind direction * scroll offset; 
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// Define step size constants 

float near step size - 3.0; 

float far step size offset - 60.0; 

float step adjustment distance - 16384.0; 


// Calculate distanced-based step size 


float step size = near step size + ((far step size offset * distance from camera) / step adjustment distance); 
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float HenyeyGreenstein(float inCosAngle, float inG) 


{ 

float num = 1.0 - inG * inG; 

float denom = 1.0 + inG * inG - 2.0 * inG * inCosAngle; 

float rsqrt_denom = rsart(denom); 

return num * rsart denom * rsqrt denom * rsart denom * (1.0 / (4.0 * M PI)); 
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float ms volume - Remap(dimensional profile* step size, 0.1, 1.0, 0.0, 1.9) 
ms volume *- pow(attenuated light, cMultipleScatteringDepthPower); 


ms volume *- pow(height fraction, cMultipleScatteringHeightPower); 
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float ambient scattering - pow(1.0 - dimensional profile, 0.5); 
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// Accumulate light absorption from sampled density 
light absorption += sampled density * (1.0 - light absorption); 


// Accumulate energy and attenuate based on depth in the cloud along the view ray 
light intensity += (light energy * sampled density * (1.0 - light absorption)); 


// Accumulate energy and attenuate based on depth in the cloud along the view ray 
float3 color = float4(direct intensity * sun color + amb intensity * amb color); 
float alpha - light absorption; 
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float density = ValueRemap(cloud type, 0.5, 1.0, ValueRemap(cloud type, 0.0, 0.5, cr streaky, cr wispy), cnr round); 
density - pow(density, 1.0 - ValueRemap(cloud coverage, 0.0, 1.0, -0.9, 0.9)); 
density *- ValueRemap(pow(cloud coverage, 3.0), 0.0, 0.5, 0.0, 1.0); 
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heart of the clouds and then fall back, some distance away, 
in the unusual form of a shower of batrachians. 

The tornado that rages in North America, takes on a 
terrifying aspect, affecting regions some hundreds of yards 
wide by fifteen, thirty, or even sixty miles long. 


Sedentary clouds 


For respite from these apocalyptic spectacles, and to 
make peace with the cloud world, let us go to the mountains. 

On calm days in the fine season, the summit of a peak or 
an isolated mountain may be covered by a hood of a cloud 
which sends its peak rather high into the clear sky. This 
immobile cumulus seems to keep watch as long as the rise of 
humid and warm air from the valley provides sufficient 
expansion to cause condensation; that is from mid-morning 
to late afternoon. 

If the condensation level is below the mountain peak, 
the mountain may be surrounded by a collar of clouds, 
similar to a giant, immobile smoke-ring. 

It may also happen that the mountains unfurl to the 
wind a banner of clouds caught at their peaks, continually 
reforming only to disperse some tens or hundreds of yards 
farther on. As a consequence of the ascending motion of 
the threads of air along the slopes, the formation of this 
cloud requires certain specific conditions: the condensation 
level must correspond to that at the summit of the mountain 
and, on the other hand, a strong wind must cause the rapid 
ascent of air along a slope; then, when it reaches thesummit, 
this air abandons its surplus humidity in the form of drops. 
Afterward the air, hugging in its course the profile of the 
mountain, redescends on the other side. It is here that the 
opposite phenomenon intervenes: while the ascent caused 


Orographic clouds 


Orographic clouds are sometimes detached from the 
projection that causes them. The spectacle of these 
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Cloud banner on the side of a mountain 


immobile clouds, anchored in the wind, is quite surprising. 
Elongated at the two extremities, these clouds in the form 
of a giant lentil (they are called alto-cumulus lenticularis) 
form at the summit of waves caused by the obstacle of the 
mountain, in the wind's eye, however little assistance 
humidity and temperature conditions may offer. 

These invisible waves, on the cloud crests, can extend 
horizontally over several miles, materialized in hyphens or 
ellipses scattered through the sky. Sometimes when the air 
is overlaid with alternately humid and dry layers super- 
posed lenticular clouds, seen from the earth, give the 
impression of a pile of dishes which the imagination some- 
times transforms into giant rotating saucers. 

At New Amsterdam Island, lost in the South Indian Ocean 
such cloud masses are often seen; they are due to simultane- 
ous action of insular projection and contrasts of temperature 
existing between the hot currents of subtropical regions and 
cold currents of the Antarctic. The action of the latter on 
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// Construct Dimensional Profile. 

float cloud coverage = GetCloudCoverageSample(sample position); (1 Texture Read) 
float vertical profile = GetVerticalProfile(sample position); (2 Texture Reads) 
float dimensional profile = vertical profile * cloud coverage; (1 Multiply) 


// Test if this is empty space and exit. 


if ( dimensional profile « density threshold) 
return 0.0; 
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top gradient bottom gradient 


min height 


max height edge gradient 


// Construct Dimensional Profile. 

float height fraction - Remap(height, min height, max height, 0.0, 1.0); 
float top gradient - pow( 1.0 - height fraction, 1.5); 

float bottom gradient - pow( height fraction, 2.0); 

float edge gradient - Remap( sample height, 0.0, 35.0, 1.0, 0.0); 


float dimensional profile - bottom gradient * top gradient * edge gradient; 
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cloud type = 0.25 


float noise height blend = Remap(height fraction, cloud type + 0.1, cloud type - 0.1); 
float composite - lerp(wispy noise, billowy noise, noise height blend); 
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float3 noise sample pos = inSamplePosition + float3(0.0, 0.0, (1.0 - saturate((max height - min height) * 0.0125)) * 40.0 ); 
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// Get cloud density 


float cloud density sample - height fraction * pow(saturate(noise composite - (1.0 - dimensional profile)), 0.27); 


// The inverse edge signal is powered by three and used to fade off the edges of clouds in several places below this 
float inv edge signal pow 3 = pow(inv edge signal, 3.0); 


// Define Samples 


float cloud density - cloud density sample; 
float cloud coarse density - pow(ValueErosion(dimensional profile, 0.04), 0.5) * inv edge signal pow 3 * 5.0; 
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“Envelope Model NDF Definition" 
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Light Energy = Direct Scattering + Ambient Scattering 
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// Calculate Transmittance 
float transmittance - exp(-inSummedSamples); 


// Get Long Distance Shadow Sample 
float long distance shadow sample = SampleLongDistanceShadowMap(inSamplePosition) ; 


// Define Direct Scattering 
float direct scattering - transmittance * long distance shadow sample; 
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// Get the height fraction so that we can reduce the ambient influence at the bottoms of envelope model clouds 
float height fraction - ValueRemap(inSamplePosition.z, min height, max height. 0.0, 1.0); 


// Define Ambient Scattering 
float ambient scattering - pow(1.0 - saturate(cloud coarse density), 0.25) * height fraction; 
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Sphere Tracing 


Hart, John C. 1995. 
“Sphere Tracing: Simple Robust 
Antialiased Rendering of Distance-Based 
Implicit Surfaces” 
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Cone Step Mapping 


Dummer, Jonathan. 2006. 
"Cone Step Mapping: An Iterative 
Ray-Heightfield Intersection Algorithm." 
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“Envelope Model NDF Definition" 
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“Superstorm Influence NDFs” 
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Fluid Simulations by Andrew Schneider (Houdini/Maya) 
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float noise - SampleNoise(GetRotatedPosition( sample position, superstorm center, time offset)); 
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float noise - SampleNoise(GetRotatedPosition( sample position, superstorm center, time offset * RingRotationSpeed[n])); 
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float noise = SampleNoise(GetRotatedPosition( sample position, superstorm center, time offset * ring rotation speed[n] + ring skew[n])); 
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// Get world space cloud position 

float3 view space vec - CreateEyeRay(inViewportUV, inFovScale); 

float cloud distance = inCloudAttrWorkingBuffer.SampleLOD(inSampler, inUV, @).r; 

float3 cloud world space = mul(inInvViewMatrix, float4(view space vec * cloud distance, 1.0)).xyz; 


// Rotate around superstorm center 

float rotation speed - GetSuperstormRotationSpeed(cloud world space.xy, superstorm center, superstorm radius, superstorm blend factor); 
float2 rotating motion offset - GetRotatedPosition(cloud world space.xy, superstorm center, rotation speed * inDeltaTime); 

float3 superstorm rotated world space position - float3(0.0, 0.0, cloud world space.z); 

superstorm rotated world space position.xy - rotating motion offset; 


// Get superstorm mask for blending - powered linear distance from radius to center of superstorm 
float superstorm mask - pow(saturate(1.0 - length(cloud world space.xy - superstorm center) / superstorm radius), 0.1); 


// Blend vectors from normal to superstorm over superstorm mask. 
cloud world space - lerp(cloud world space, superstorm rotated world space position, superstorm mask); 
view space vec - mul(inViewMatrix, float4(cloud world space, 1.0)).xyz; 


// Construct previous sample position from new view space vector 

float4 prev sample pos - mul(inReprojectionMatrix, float4(view space vec, 1.0)); 
prev sample pos /- prev sample pos.w; 

prev sample pos.xy *- float2(0.5, -0.5) 

prev sample pos.xy += float2(0.5, 0.5); 
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// Get world space cloud position 

float3 view space vec - CreateEyeRay(inViewportUV, inFovScale); 

float cloud distance = inCloudAttrWorkingBuffer.SampleLOD(inSampler, inUV, ®).r; 

float3 cloud world space - mul(inInvViewMatrix, float4(view space vec * cloud distance, 1.0)).xyz; 


// Rotate around superstorm center 

float rotation speed - GetSuperstormRotationSpeed(cloud world space.xy, superstorm center, superstorm radius, superstorm blend factor); 
float2 rotating motion offset - GetRotatedPosition(cloud world space.xy, superstorm center, rotation speed * inDeltaTime); 

float3 superstorm rotated world space position - float3(0.0, 0.0, cloud world space.z); 

superstorm rotated world space position.xy - rotating motion offset; 


// Get superstorm mask for blending - powered linear distance from radius to center of superstorm 
float superstorm mask - pow(saturate(1.0 - length(cloud world space.xy - superstorm center) / superstorm radius), 0.1); 


// Blend vectors from normal to superstorm over superstorm mask. 


cloud world space = lerp(cloud world space + scroll direction 2D * inDeltaTime, superstorm rotated world space position, superstorm mask); 
view space vec = mul(inViewMatrix, float4(cloud world space, 1.0)).xyz; 


// Construct previous sample position from new view space vector 

float4 prev sample pos - mul(inReprojectionMatrix, float4(view space vec, 1.0)); 
prev sample pos /- prev sample pos.w; 

prev sample pos.xy *- float2(0.5, -0.5) 

prev sample pos.xy += float2(0.5, 0.5); 
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density scale = pow(min(1.0 - (dist / radius), 0.0) + 1.0, 0.5); 


summed density += d(n) * density scale; 


transmittance - exp( -1.0 * (summed density)); 
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amb settings blend - min(1.0 - (disti / radius), 0.0) * (dist2 / height); 


ambient scattering settings - lerp(cloud amb settings, superstorm amb settings, amb settings blend); 
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cloud bottom 


potential energy 


pow( 1.0 - (d1 / radius), 12.0); 


height gradient - (d2 / height); 
pseudo attenuation - (1.0 - saturate(fine density * 5.0)); 
glow energy = potential energy * height gradient * pseudo attenuation; 


light energy = direct scattering + ambient scattering + glow energy; 
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PlayStation 4 PlayStation 5 


Max Resolution 960 x 540 1920 x 1080 


Light Ray Samples 


View Ray Samples 


Blur Scale (Pixels) 


Noise Texture MIP Level 
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while (..) 
{ 


} 


distance_sum += d[n] * sample_opacity; 


float weighted_sum = distance_sum / opacity_sum; 
cloud_color = lerp(cloud_color, atmospherics_color, weighted_sum); 
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SIGGRAPH 2011, Vancouver 


Clouds in the skies of Rio 


Andrew P. Schneider 


Figure 1: Blu and Jewel hangliding through the clouds over Rio. 
Rio@ 2011 Twentieth Century Fox Film Corporation. All Rights 
Reserved. 


1 Introduction 


Trevor G. Thomson 
Blue S 


Mathew S. Wilson 
Studios” 


clouds into a scene, modified them, and wrote a low resolution ver- 
sion of each cloud to disk. The resampled resolution was arrived at 
interactively inside of Houdini based on each clouds distance from 
camera. In this case, evolution was applied at render time by skew- 
ing each voxel grid and deforming the noise coordinates according 
to wind direction and speed. For long sequences like the one whe 
Blu and Jewel fly over Rio (Fig. 1), we placed all of the clouds into 
a master set, and then adjusted as needed per shot. 


Finally, for distant shots, where clouds were so distant that parallax 
was of no concern, RGB renders of assets from the cloud library 
were placed in 3D composite space and then relit in Nuke. These 
cloud cards were then combined with rendered versions of other 
3D clouds in the shot into a "sky set" that could be shared across 
multiple shots and sequences. We developed a number of tools to 
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Source-Agnostic Distance Step Mapping 
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